
DATA INSERTION DEVICE AND METHOD OF INSERTING DATA 


F^iri of t-he Invention 

The invention relates to a device and method for 
inserting data and, in particular, to a data insertion 
method which inserts predetermined pattern data, such as 
digital watermarking data, to digital i^age data comprised 
by MPEG2 (Moving Picture Experts Group 2) . 

pg^r-Lptjon of tTi*» Bflntftd Art 

Conventionally, a kind of data insertion devices 
(cixcuits) are used to insert data to digital image data. 

Some of the conventional devices provide digital 
watermarking by inserting pattern data into MPEG2 data 
including a seance of pictures each of which belongs to 
one of I picture (Intra picture) , P picture (Predictive 
picture) , and B picture (Bidirectionally predictive-coded 
picture) . 

However, the conventional devices have a problem that 
a quality of image deteriorates. 

The reason is that, a data amount of the pattern data 
inserted into a P picture is larger than an data amount of 
the pattern data inserted to an I picture, considering a 
decoding procedure of each picture, and therefore, in the P 
picture, there becomes a large difference between the P 
picture in which the pattern data are inserted and the 
original inage data to be included in the P picture. 
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Moreover, when the . data amount: of the pattern data 
inserted into each picture varies, it seems that a moving 
picture resulted from a series of pictures waves . 

flTTHM ^Y of TFT TvrvrarriOK;. 

Therefore, it is an object of the invention to 
provide a device and a method for inserting digital 
watermarking data to image data without a degradation of an 
image quality of the image data. 

Acceding to a first aspect of the invention, there 
is provided a data insertion device which inserts 
predetermined patter* data into compressed image data. 

According to a second aspect of the invention, there 
t, provided a data insertion device which includas an input 
device which inputs iunage data including a plurality of 
types of pictures, a determining device which determines 
the type of the picture for each picture , and an inserting 
device which inserts pattern data into each picture with an 
insertion intensity according to the type determined about 

tLhe corresponding picture. 

According to a third aspect of the invention, there 
is provided the data insertion device of the second aspect, 
wherein the inserting device modifies the pattern data to 
have tho insertion intensity and inserts the modified 
pattern data into the picture. 

According to a fourth aspect of the invention, there 
is provided the data insertion device of the third aspect, 
wherein the modification is done by multiplying the pattern 
data by a multiplier rate which is adjusted according to 
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the determined type . 

According to a fifth aspect of the invention, there 
is provided the data insertion device of the second aspect, 
wherein a group of pattern data are prepared each of which 
are generated so as to have the insertion intensity 
according to one of the types of the pictures, and the 
inserting device ' selects one of the group of pattern data 
and inserts them into the corresponding picture. 

According to a sixth aspect of the invention, there 
is provided the data insertion device of the second aspect, 
wherein the pattern data includes information related to 
digital watermarking. 

According to a seventh aspect of the invention, there 
is provided the data insertion device of the second aspect, 
wherein the image data are MPEG2 data, and the types of 
pictures includes I picture, P picture, and B picture. 

According to an eighth aspect of the invention, there 
is provided a method of inserting data. The method 
comprises the steps of inputting image data including a 
plurality of types of pictures, determining the type of the 
picture for each picture, and inserting pattern data into 
each picture with an insertion intensity according to the 
type determined about the corresponding picture. 

According to a ninth aspect of the invention, there 
is provided a recording medium readable by a computer, 
tangibly embodying a program of instructions executable by 
the computer to perform a method of inserting data. The 
. method comprises the steps of inputting image data 

including a- plurality of types of pictures, determining the 
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type of the picture for each picture, and inserting pattern 
data into each picture with an insertion intensity 
according to the type determined about the corresponding 
picture . 

According to a tenth aspect of the invention, there 
is provided a computer data signal embodied in a carrier 
H1V9 and representing a sequence of instructions which, 
when executed by a processor, cause the processor to 
perform a method of inserting data. The method comprises 
the steps of inputting image data including a plurality of 
types of pictures, determining the type of the picture for 
each picture, and inserting pattern data into each picture 
with an insertion intensity according to the type 
determined about the corresponding picture. 

According to an eleventh aspect of the invention, 
there is provided a program product comprising, computer 
readable instructions and a recording medium bearing the 
computer readable instructions, the instructions being 
adaptable to enable a computer to perform a method of 
inserting data. The method comprising the steps of 
inputting image data including a plurality of types of 
pictures, determining the type of the picture for each 
picture, and inserting pattern data into each picture with 
an insertion intensity according to the type determined 
about the corresponding picture. ^ 


nPTr.y DESC P TPTTnN OF THK DRAWINGS ;. 
Fig. .1 shows a block diagram of a conventional 
insertion/detection system; 


Fig. 2 shows a composition of a conventional data 

insertion circuit ; 

Fig. 3 shows a block diagram of a first embodiment of 

the invention ; and 

Fig. 4 shows a block diagram of a second embodiment 

of the invention. 

pB'ir'RT pttok OF Tjff LJZBEEEBBED FHRoPTHFiNT : 

At first, description is made about an example of the 

conventional data insertion/detection system with reference 

to Fig . 1 . 

The system includes a data insertion circuit 1 and a 
data detection circuit 2. The data insertion circuit 1 is a 
circuit which generates pattern data and inserts the data 
into digital image data. 

The data insertion circuit 1 includes an inserting 
device 201 and a pattern generator 202. When the pattern 
generator 202 generates the pattern data based on 
information related to a digital watermarking , according to 
a certain rule. Then, the pattern data are inserted into 
the digital image data by the inserting device 201. 

The digital image data thus including the pattern 
data are then recorded on a storage medium, such as a disk 
203. The data detection circuit 2 extracts the pattern data 
from the digital image data recorded on the storage medium. 

The extracted pattern data are then used to decode 
the information related to the digital watermarking, 
according to a predetermined rule. 



Next, description is made about another insertion 
circuit for providing a digital watermarking to digital 
image data coded by MPEG2 (MPEG2 data) , with reference to 
Tig. 2. Fig. 2 shows a composition of the insertion circuit. 
The insertion circuit includes a VLD (Variable Length 
Decoder) 101, a multiplier 103, an adder 104, and a VLC 
(Variable Length Coder) 105. 

The MFEG2 data are obtained by encoding (and 
compressing) digital image data using a digital image 
coding method MPEG2 - 

Since the MPEG2 data are coded in a variable length, 
before insertion of the digital watermarking, the MPEG2 
data are decoded by the VLD 101 . 

Pattern data which are to be inserted in the MPEG2 
data and are related to a digital watermarking, can be 
obtained in the same way as described in Fig. 1. Also, an 
insertion intensity of the pattern data is adjusted by 
computing a certain multiplying rate using the multiplier 
103. And then, the pattern data are inserted into the 
decoded MPEG2 data by the adder 104. The decoded MPEG2 data 
which are supplied form the adder 104 are again coded in a 
variable length by the VLC 105 (Variable Length Coder) and 
supplied as MPEG2 data . 

The MPEG2 data includes, as described above, three 
types of pictures, that is, I picture, P picture, and B 
picture 

When the MPEG2 data are decoded to generate a moving 
picture, I picture, P picture, and B picture are decoded by 
using each decode procedure . 


That ±3, I picture is decoded by using the I picture 
its own to generate a picture in a moving picture. P 
picture is decoded by. using I picture and/or P picture (s) 
before the current P picture, and the current P picture its 
own . 

Further, B picture is decoded by using I picture 
and/ or P picture (s) before the B picture -or after the B 
picture. 

A moving picture is provided by processing the above 

decoding process in order. 

Here, a general composition of the MPEG2 data of KTSC 
(National Television System Committee) is shown below as 
example, and the general composition is explained with 
reference to the example. 

In addition, Ix denotes an I picture, Px denotes a P 

picture, and Bx denotes a B picture. 

(II, Bl. B2, PI, B3, B4, P2 , BS , B6, P3 , B7 , B8 , P4, 

B9, BIO) 

When the shown sequence of the pictures are inputted 
into the insertion device shown in Fig. 2. pattern data are 
inserted into each data (H, Bl , ...)- 

When the MPEG2 data are decoded as described above, 
an I picture is decoded by using only an I picture II. 
However, a P picture related to PI « decoded from an I 
picture II and a P picture Pi, and another P picture 
related to P2 is decoded by using P pictures Pi and P2 . 

Moreover, B picture related to Bl is decoded from an 
" I. picture 11/ a P picture Pi, and a B picture Bl, and a B 
picture related to B2 is decoded from an I picture II, a P 
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picture Pi, and a B picture B2 . 

Here, although the pattern data are inserted into 
each picture (II, Bl , . . .), when the P picture related to 
PI are, for example, decoded, the pattern data included in 
the I picture II and the P . picture Pi are accumulated and 
extracted, since in decoding the P picture, the I picture 
II and the P picture Pi are used. 

Similarly, since the P pictures Pi and P2 are used 
when the P picture related to P2 is decoded, and the I 
picture II and the P picture PI are used to decode tho P 
picture corresponding to picture data PI, pattern data 
which are inserted into the I picture II, and the P 
pictures PI and P2 are accumulated and extracted in 
decoding the P picture related to picture data P2 . 

When the B picture related to Bx is decoded, an I 
picture Ix and a P picture Px which are located before or 
after the B picture Bx are ua«d. Howovar , the B picture Bx 
originally have a relatively small size in length. 
Therefore, a small amount of pattern data should be 
inserted into the B picture. 

Also, since the I picture Ix and the P picture Px are 
used in the decoding, it is possible to apply a small 
insertion intensity of the pattern data about the B picture. 
Howevor, for the B picture, the same insertion intensity is 
conventionally used as that of the I picture and the P 
picture. 

Next, description is mado about a first embodiment of 
the invention, with reference to Fig. 3. An insertion 
device is shown in Fig. 3 according to the first embodiment 
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of the invention. The insertion device includes a VXD 101 , 
a picture type determining device 102, a multiplier 103, an 
adder 104, and a VXC 105. 

The picture type determining device 102 determines 
whether a received picture of MPEG2 data belongs to an I 
picture, a P picture, or a B picture. The VXD 101 decodes 
tho received MFEG2 data (picture) in a variable length. 

The multiplier 103 receives a determining result from 
the picture type determining device 102 and pattern data, 
and multiplies a value of the pattern data by a certain 
multiplier based on the result. The adder 104 inserts the 
multiplied pattern data to the decoded MPEG2 data sent from 
the VXD 100. The VXC 105 codes the decoded MFEG2 data with 
the inserted pattern data, in variable length to generate 
KPEG2 data. 

Next, operations of the insertion device shown in Fig. 
3 are explained below. 

First, the MPEG2 data are sent to the VXD 101 and the 
picture type determining device 102 picture by picture. 
When the picture type determining device 102 receives the 
picture of the MPEG2 data, the device determines whether 
the picture is an I picture, a P picture, or a B picture. 
The determination is easily carried out by extracting 
"Picture Coding Typo" from a picture header in the picture . 
The determining result is then sent to the multiplier 103. 

At the VXD 101, the MFEG2 data are decoded. 

The multiplier 103 multiplies the pattern data by a 
certain multiplier based on the determining result. For 
example/ if the received picture is an I picture, the 
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multiplier is set to 1-0, if the picture is a P picture, 
the multiplier is set to 0.3, and if the picture is B 
picture, the multiplier is set to 0.1. The multiplying 
result is then sent to the adder 104 and wherein, the 
multiplied pattern data are inserted into decoded data from 
the VLD 101". 

The data in which the pattern data are inserted are 
then coded in a variable length by the VLC 105 and provided 
as MPEG2 data including the pattern data of digital 
watermarking. 

As described above, the insertion intensity of 
pattern data can be adjusted by changing a value of the 
multiplier according to a type of the received picture. In 
the above example, the insertion intensity of pattern data 
about a P picture and a B picture i3 controlled to be 
smaller than that about an X picture. Thereby, when the 
MPEG2 data are decoded to gonorate a moving picture, 
degradation of image quality can be prevented since each 
picture is decoded from the MEEG2 data to have a similar 
amount of pattern data. That is, regardless of the number 
or type of pictures (for example, I picture, P picture, B 
picture) which are used to decode a picture of a moving 
picture, an approximately fixed amount of pattern data are 
included . 

Then, description is made about a second embodiment 
of the invention with reference to Fig. 4. In Fig. 4, an 
insertion device according to the second embodiment of the 
invention is shown, which is different from the insertion 
device shown in Fig. 3 in that the multiplier 103 is 
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replaced by a selector 10 6. 

The selector 10 6 receives, in advance, three pattern 
data, that is, pattern data 1, pattern data 2, and pattern 
data 3 . Each of the pattern data includes an insertion 
intensity sent to the adder 104 and corresponds to one of 
types of pictures, an I picture, a P picture, and a B 
picture. The selector 10 6 selects one of tha pattarn data 
according to a determining result from the picture 
determining device 102, and sends the selected pattern data 
to the adder 104. 

The adder 104 receives the decoded MPEG2 data from 
the VXD 101 and the pattern data from the selector 106, and 
wherein, the pattern data are inserted into the decoded 
MPEG2 data. The decoded MPEG2 data in which the pattern 
data are inserted are then sent to VT-C 105. The VLC 105 
codes the decoded MPEG2 data in a variable length. 

Therefore, when the MP EG 2 data supplied from the VLC 
105 are decoded to generate a moving picture, degradation 
of an image quality can be prevented since an amount of the 
pattern data is adjusted according to an amount of the 
picture in the MPEG2 data. 

As described above, an effect of the invention is to. 
be able to prevent from degradation of an image quality. 
The technique of .the invention can be applied to other 
various image coding method other than MPEG2 . 

According to the invention, pattern data are inserted 
to each picture of MPEG2 data with an insertion intensity 
which is adjusted based on a type of picture. Therefore, 
when the MPEG2 data are expanded, each picture has a 


similar ' quantity of pattern 
the picture, which causes a 
prevented. 
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data. As a result, a noise of 
waved picture, is effectively 


